Analytic Formulation, Exact Solutions, and Generalizations of the 
Elephant and the Alzheimer Random Walks 
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An analytic formulation of memory-possessing random walks introduced recently [Cressoni et 
al., Phys. Rev. Lett. 98, 070603 (2007) and Schutz and Trimper, Phys. Rev. E 70, 045101 
(2004)] for Alzheimer behavior and related phenomena is provided along with exact solutions on 
the basis of Fokker-Planck equations. The solution of a delay-differential equation derived for 
the purpose is shown to produce log-periodic oscillations and to coincide rather accurately with 
previously published computer simulation results. Generalizations along several directions are also 
constructed on the basis of the formalism. 
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Two remarkable publications have recently appeared 
on the subject of random walks with memory, one in- 
volving the 'elephant walk' in which the walker chooses 
steps randomly but is influenced by a perfect memory 
of steps taken earlier and the other involving an ex- 
tension of this walk to incorporate partial memory of 
steps from the beginning up to a time in the past 0. 
While an analytical description has been given for the 
(former) elephant walk, it appears to have been impossi- 
ble to provide one for the partial memory extension. The 
significance of the latter is that it has been proposed 
for the medically important analysis of amnestically in- 
duced behavior of Alzheimer patients. The authors of 
Ref. 0] have presented impressive computer simulations 
of the Alzheimer walk exhibiting log-periodic oscillations 
in the displacement of the walker, and deduced intrigu- 
ing conclusions regarding the elements of persistence and 
what they have called, following Schiitz and Trimper [l|, 
traditional versus reformer behavior of the walker. They 
have also stated that an analytic solution of their par- 
tial memory extension (the Alzheimer walk) remains an 
open problem. The present Letter is aimed at solving 
that problem. 

As a result of both its complexity and its usefulness, 
the general subject of random walks has occupied excep- 
tional minds for a long time whether in physics Q or in 
other areas of research Contributions in this topic 
and related areas have continued to be made in phys- 
ical JE IE SI, as well as interdisciplinary sciences 
SOOlIa such as sociology, economics and ecology. 
Progress in the subject has, obviously, multiple beneficial 
effects. 

Let us restrict the analysis to 1-d for simplicity. The 
original elephant walk f]\ envisages a walker that initially 
starts out in one direction, remembers its entire history 
at any time, selects with uniform probability any of the 
steps taken in the past and then imitates that step with 
probability p or takes the reverse step with probability 
1—p where < p < 1. The extension introduced by Cres- 
soni et al. is to restrict the memory of the walker to 



a fraction / of the total time t elapsed. While this single 
change results, as shown in Ref. y, in noteworthy con- 
sequences such as log-periodic oscillations, it also makes 
analytic understanding of the evolution difficult. 

The present analysis is based on a Fokker-Planck equa- 
tion, in continuous time t and space cc, for the probability 
density P{x, t) of the walker, arrived at by combining the 
standard continuity equation for P{x, t) and a constitu- 
tive equation relating the latter to the current density 
j{x,t). The constitutive equation is determined by the 
rules of the random walk. Let us first attempt the form 



jix,t) = -[xPixJt)] 



D 



dP{x,t) 
dx 



(1) 



following the notation of Ref. [1] rather than of Ref. 0]: 
the symbol a represents 2p ~ 1 rather than the Hurst 
exponent. The resulting Fokker-Planck equation (FPE) 
would then be 



dP{x,t) 
dt 



a d 
Jt'di 



[xP{x, ft)] + D 



d'^P{x,t) 
dx"^ 



(2) 



and reduce in its perfect memory version (/ = 1) to the 
FPE given as a large t and x limit in Ref. [l| . The second 
term in each of equations ([T]) and ([2]) refers to the random 
element in the walk whereas the first term expresses the 
fact that the change in the displacement (the next step 
taken) at time t is related to an average with uniform 
weight of all earlier displacements until ft, the ft in the 
denominator being a normalizing factor. 

Multiplying ([2]) by x and integrating, we get for the 
first moment x{t) ~ xP{x, t)dx 



(3) 



This explicit equation for the average displacement of the 
walker may be also obtained by introducing the partial 
memory suggestion of Ref. [2] into the elephant walk 
analysis of Ref. [H, particularly equation (4) of the latter. 
Let us now solve equation ((3]) to demonstrate that the 



2 



average displacement can exhibit logarithmic oscillations 
acquiring negative as well as positive values, precisely as 
in the computer simulations of Cressoni et al. To this 
end, ([3]) may be transformed through the introduction of 
a dimensionless time T, 



T = 



In [t/to) 
ln(l//)' 

into the delay-differential equation 



dz{T) 
dT 



Bz{T- 1) 



(4) 



(5) 



where z{T) = x[to{l/f)'^] is the displacement ex- 
pressed as a function of the transformed time T, and 
B, which can be negative for reformers (p < 1/2), is 
given by (a//) In (1//). General theorems of delay- 
differential equations may be applied to determine the 
behavior. Thus, positive a will always lead to mono- 
tonic increase of the displacement but negative a may 
lead to oscillations depending on its value. In the pre- 
transformation variable t, these appear as log-periodic 
oscillations provided —B > 1/e. The present theoretical 
analysis shows that the curve 

(l-2p)ln(l//) = //e 

provides the essence of the f—p phase diagram mentioned 
by Cressoni et al. 0] on the basis of their simulations as 
separating regions displaying different behavior. 

Explicit solutions of ([5]) may be obtained via Laplace 
transforms but require specification of initial conditions 
not only at a single point but over a segment. The mo- 
ment is naturally taken to be vanishing for all times be- 
fore Iq and at that time to have the value xq in keeping 
with the problem as stated in refs. ([H, Q). The final so- 
lution of ([5]), when transformed into the ^-domain, gives 



^0 t^o 



In 



1 / ln(t/fo) 



-e(t-to(i//r) 

(6) 

where Q is the Heaviside step function-it naturally ap- 
pears because of the delay nature of the equation. 

Equation one of the main results of this Letter, 
may be considered the solution of the open problem men- 
tioned by Cressoni et al [2L Figure 1, drawn in close 
similarity to Fig. 2 of Ref. [4] compares directly the sim- 
ulation results of Cressoni et al. taken as data|15|| with 
our theoretical result 

The amazing coincidence of the analytical expression 
li{t) derived in this paper with the simulation results 
given in Ref. 2] should leave little doubt as to the cor- 
rectness of the claim that the problem, or at least those 
parts of it addressed by the first moment of the prob- 
ability distribution, has been indeed solved analytically. 
Notice that x{t) executes logarithmic oscillations of enor- 
mous amplitude over many orders of magnitude in time 




10^ 10^ 



10^ 10^ 10' 10* 



FIG. 1: Comparison of the analytic result ([6]) derived in the 
present paper with the computer simulations of Ref. 0] show- 
ing excellent agreement. Plotted is the average displacement 
of the walker for the partial memory walk as a function of time 
for p = 0.1 and various values of /, the fraction of the past 
that the walker remembers. Remarkably, the analytic curve 
coincides exactly with the simulation data over 6 orders of 
magnitude while the data executes log-periodic oscillations 
over the wide range shown. 



for negative a {p < 1/2) and yet our analytic curves fol- 
low the simulation data faithfully and accurately over the 
entire range. 

The success of the above analysis is marred by 
the fact that proceeding with higher moments from 
(PI lands one in problems. The second moment 
x'^{t) — J_^x^P(x,t)dx, when transformed into y{T) = 



x'^[to(l/ f)'^], produces 



y{T) = y{Q) f: »:J^e(r -r) + 2Dto £ 



r=0 



r=0 



{2ayr' ji^r + l,{T- r) In - j e(r - r), (7) 

7 being the incomplete gamma function. The right hand 
side of ^ can go negative for certain parameter values. 
What this means is that the FPE ([2]), although it gives 
the correct first moment, predicts probabilities that can 
go negative. An alternative FPE must be found which 
does not suffer from this shortcoming but which continues 
to predict the first moment correctly. One way to do 
this is to modify the constitutive relation ([1]) by taking 
in its first term the probability density P{x,t) at the 
present time rather than at ft and to regard the x that 
multiplies it as the location in space which, if occupied 
by the walker at time ft would bring the walker to x 
at time t. Because we have already been able in this 
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paper to solve for the trajectory equation, that is, for 
the motion of the walker in the absence of the random 
element (D = 0), the solution being in our equation 
this modification of the constitutive relation is possible to 
implement. Regarding x{t) as a trajectory variable (no 
bars over the symbol), we know it explicitly as XQii{t) in 
terms of our solution. Therefore we also know it at time 
ft in the past: it is a;o/i(/t). The latter quantity may 
then be expressed in terms of the former quantity via the 
ratio The location which, if occupied by the 

walker at time ft would bring the walker to x at time 
is thus given by the product of the present location x and 
fi{ft)/fi{t). Substituting this in the constitutive relation, 
the new form of the relation (to replace ([T])) becomes 

a nift) r^ dP{x,t) 

the a;'s in this equation being all regular variables. All 
the ingredients of 'a; at time /t' have been moved to the 
time functions. These time functions can be simplified 
as a result of ([3]) regarded as a trajectory equation. 

Finally, making the simplifications, we obtain, for the 
correct description of the first as well as the second mo- 
ments, a new form for the constitutive relation and the 

'"dt ' have 



FPE. With h{t) 



3{x,t)^h{t) [xP(x,t)]-D 



dP{x,t) 
dx 



(9) 



and 



d d'^Pix t) 

8t -m^^\^PM]^D^^. (10) 



dP{x,t) 



They lead to the mean square displacement 



a;2(i) = {x{t)f + 2D^?{t) 



ds 



(11) 



which is guaranteed to be non-negative. Both the terms 
in the right hand side are already available in the cal- 
culations in A comparison of this expression with 
the simulation data of Cressoni et al. seems to show 
reasonable agreement in both the oscillations (when they 
are present) and the overall behavior. These and other 
related matters will be the subject of a future publication 

Thus, by substituting ([9]) and (fTO|) for their earlier ver- 
sions, one is able to get accurate and consistent results for 
all moments (the first and the second moment being in 
([6l) and Indeed, using methods explained elsewhere 

[17( 1 in context of nuclear magnetic resonance microscopy, 
an explicit solution for P(x, t) can be obtained. In the 
Fourier domain, the solution is 



P{k,t) ^ P{kJ^o^'^'^'^\tQ)e L 



^2/« h(s)d< 



The first factor on the right hand side is obtained by 
replacing k in P(fc, to)j the Fourier transform of the initial 
probability density, by ke^^o h{s)ds ^ Inversion of p2)) is 
trivial [i3|. 

Next, let us consider imperfect memory generalizations 
of the elephant walk not in the sense that the walker 
has a restriction of the time for which it remembers (as 
in Ref. [2]) but to describe the situation in which the 
walker selects one of the previous steps with some given 
weight depending on when that step was taken. This 
weight will be described by a function a{t) instead of 
the constant 1. The integral of this a{t), i.e., a{s)ds, 
will be called b{t): note that b(0)=0. While in Ref. [ij 
the description is discrete-time, one may write for the 
continuous time description employed in this Letter, in 
contrast to their equation (4), x{t) = + /q a{s)ds, 
where x is the position and a is the displacement (step 
taken at time t). Generalizing via weights a(t) leads to 



dx{t) 
dt 



a(t) 



lo a{s)cr{s)ds 



(13) 



The integral of a(t) appears in the denominator for nor- 
malization. Using a{t) = db{t)/dt, one obtains 

(T{t)b{t){l -a) = -a f 6(s)^^ds, (14) 
Jo ds 

and through further differentiation, into 



dlncrlt) , ,dlnb(t) 

This leads to 

dx [b{t)]°'~^ 



dt /J[6(s)]«-id5 



x{t)-xm, 



(15) 



(16) 



to the FPE 



dPix,t) _ ^^^^ d[xP{x,t)] , ^ d^Pix,t) 

dt " ^ > dx ^ dx^ ■ ^ ' 

and to the displacement (first moment) equation 



dx{t) 
dt 



h{t)x{t) 



where the function h(t) is given by 



h(t) = 



dt 



In / [6(s)]"-ids 



(18) 



(19) 



(12) 



This generalization of the elephant walk can be solved 
explicitly for arbitrary weights a{t) for which h{t) can be 
computed. Indeed, this has already been formally done 
above in (fT2|) . One can write solutions of the FPE and 
also obtain, and solve, if necessary, arbitrary moment 
equations. As an example, note that for a{t) = Ant"^ 



4 



where An is a constant, little seems to change relative 
to the simple elephant walk case n = except that the 
coefficient a is replaced by {n + l)a — n. Nevertheless, 
it should be noticed that the change is not trivial. With 
p lying between 1/2 and 1, or a = 2p — 1 lying between 
and 1 (probability of rightward march), [n + \)a n 
can become negative. Reformer behavior will then occur 
even for a positive a. 

It is also instructive to see how the original results of 
Schiitz and Trimper [H can be obtained straightforwardly 
from our formalism. If we take the governing equation 
to be (jlOp with h{t) = a/t, the complete solution is in 
our expression p2|) . Inverting the Fourier transform, one 
obtains for P{x,t), ^ 



P{x,t) 



the first moment being given by 

x{t) = XoC{t), 



(20) 



(21) 



^ playing the same role here as /i in the imperfect memory 
case. The second moment is 



x^t)^[x„at)? + ^Driit)- 



(22) 



The functions ^(t) and rjit) in these formulae may be 
computed for arbitrary h{s) via 



Jto Jta ? (*) 



(23) 
(24) 



but reduce, for the elephant walk, to ^{t) ~ (t/to)" al- 



ways, and to ri{t) — * 
case ri{t) = t In (t/to) 



unless a = 1/2 in which 



1-2q 

We see that for sufficiently large 
times the larger power of t dominates and so, one gets the 
interesting transition pointed out by Schiitz and Trimper 
[ij. Fora < 1/2, we have a linear t-behavior of rj whereas 
for a > 1/2, rj goes as t^"'. This is also seen in the mean 
square displacement: 



x2(t) 



2DtQ 
1 - 2a 



t 



to \to 



(25) 



Many other results from Ref.pj] can be rederived in this 
manner but will not be shown for want of space. 

In summary, this Letter has provided an analytic for- 
mulation and exact solutions for memory-possessing ran- 
dom walks exhibiting novel effects such as persistent be- 
havior and log-periodic solutions formerly found only via 
computer simulations. Whether or not Alzheimer walks 
as proposed by Cressoni et al. 0] will have medical sig- 
nificance, they are certainly interesting random walks in 
their own right. It is hoped that this work has made 



a contribution towards their understanding. We note 
in passing that here we have refrained from introduc- 
ing memory functions into the diffusion term (the last 
term of the Fokker-Planck equation) which is typically 
the place memories have been often introduced in the 
past to study coherence [1] turning diffusion equations 
into telegrapher's equations and including thus wave ef- 
fects. That is a quite different family of effects from those 
studied in refs. jll, 0] or here. 
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